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The MAILING DATE of this communication appears on the cover sheet with the correspondence address 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )E3 Responsive to communication(s) filed on 01 July 2005 . 
2a)E3 This action is FINAL. 2b)D This action is non-final. 

3) Q Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims j^^ff 

4) [El Claim(s) tt d'aiiU 2?-4*3 " \$Iare pendin g in the application. j^^^J) 

4a) Of the above claim(s) ^" IsTare withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) ^ Claim(s) 1-18 and 27-43 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10)S The drawing(s) filed on 27 August 2001 is/are: a)£3 accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
1 1 )□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12)D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 
a)D All b)D Some * c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2.D Certified copies of the priority documents have been received in Application No. . 


3.D Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 


Response to Amendment 


1. In response to the office action from 2/1/2005, the applicant has submitted an 
amendment, filed 7/1/2005, amending claims 1, 7, 9-11, 18, 27, 33, and 37, while arguing to 
traverse the art rejection based on the limitation regarding one or more first stage classifiers and 
a final stage metalearner classifier (Amendment, Page 12). The applicant's arguments have been 
fully considered but are moot with respect to the new grounds of rejection, necessitated by the 
claim amendments and in view of Soltau et al ("Recognition of Music Types, " 1998). 

2. Due to the amendments to claims 7 and 33, the examiner has withdrawn the previous 35 
U.S.C. 1 12, second paragraph rejection directed towards a lack of proper antecedent basis. 

3. The applicant has not officially challenged the official notice taken with respect to claims 
16, 18, and 42, thereby making the use of pulse code modulation and a computer readable 
medium containing a program the applicant's admitted prior art. 

Claim Rejections - 35 USC § 103 


4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 
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(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

5. Claims 1-6, 11, 15, 17, 27-32, 37, 41, and 43 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Matityaho et al ("Neural Network Based Model for Classification of 
Music Type, " March 1995) in view of Soltau et al ("Recognition of Music Types, " 1998). 
With respect to Claims 1 and 27, Matityaho discloses: 

Processing the audio signal into a perceptual representation of its constituent frequencies 
(frequency analysis, Pages 1-2, Section IIA); 

Processing said perceptual representation into at least one learning representation of said 
audio data stream (successive vectors representing music intervals, Pages 1-2, Section IIA); 

Inputting at least one said learning representation into a multi-stage classifier, whereby 
said multi-stage classifier extracts classifying data from said learning representations and outputs 
the classification of said audio signal (neural network input, Pages 1-2, Section IIA, and 
decision, Fig. 1, Page 2, Section IIB). 

Matityaho does not specifically teach that a multi-stage classifier comprises one or more 
first stage classifiers for generating a metalearner vector and a final state metalearner classifier, 
however Soltau discloses a process of vector classification according to event counting to 
produce a learning vector for input into a neural network for music classification (Pages 2-3, 
Section 2.3 and Fig. I). 

Matityaho and Soltau are analogous art because they are from a similar field of endeavor 
in music classification. Thus, it would have been obvious to a person of ordinary skill in the art, 
at the time of invention, to modify the teachings of Matityaho with the additional vector 
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processing taught by Soltau in order to implement more efficient learning in a neural network 
through vector dimension reduction (Soltau, Page 3, Section 23). 

With respect to Claims 2 and 28, Matityaho recites: 
The step of processing the audio data into a perceptual representation of its constituent 
frequencies comprises calculating, for a time sample window of a digital representation of said 
audio signal, a Fast Fourier Transform function (FFT, Pages 1-2, Section IIA). 

With respect to Claims 3 and 29, Matityaho discloses: 

The step of processing said perceptual representation into at least one learning 
representation further comprises dividing said perceptual representation into a plurality of time 
slices (successive vectors representing music intervals, Pages 1-2, Section IIA). 

With respect to Claims 4 and 30, Matityaho recites: 
Each of said time slices is about 0.8 to about 1 .2 seconds in length (0. 7 sec time interval, which 
is about 0.8 seconds, Page 5, Section IV). 

With respect to Claims 5 and 31, Matityaho discloses: 
The step of dividing the perceptual representation into learning representations further comprises 
dividing said perceptual representation into a plurality of frequency bands (frequency segments 
having a frequency separation, Pages 1-2, Section II A, and Page 5, Section IV). 

With respect to Claims 6 and 32, Matityaho in view of Soltau teaches the method and 
system for music classification utilizing multiple frequency bands as applied to Claim 5. 
Matityaho in view of Soltau does not teach dividing a musical signal into 20 frequency bands, 
however, it would have been obvious matter of design choice to do so, since the applicant has 
not disclosed that the use of dividing a music signal into 20 frequency bands solves any stated 
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problem or is for any specific purpose other than the fact that it is chosen based upon trial and 
error testing (specification, paragraph 29). The use of the 20 frequency bands for music signal 
division is akin to optimizing the values of a result effective variable (in this instance 20 
frequency bands was determined as an optimal band number for effective machine learning 
through trail and error testing). Therefore, determining the optimal value of a result effective 
variable would have been obvious and ordinarily within the skill of the art. In re Boesch, 617 
F.2d 272, 276, 205 USPQ 215, 219 (CCPA 1980). 

With respect to Claim 11 and 37, Soltau further recites: 
The final stage of said multi-stage classifier comprises a neural network (neural network, Fig. I). 

With respect to Claims 15 and 41, Matityaho discloses: 
Classifying data comprises at least one of artist and genre (music type, Page 1, Abstract). 

With respect to Claims 17 and 43, Matityaho recites: 
Measuring the confidence of said classification by said multi-stage classifier (success rate, Page 
4, Section IIIB). 

6. Claims 16, 18, and 42 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Matityaho et al in view of Soltau, and further in view of the applicant's admitted prior art. 

With respect to Claims 16 and 42, Matityaho teaches the method and system for music 
classification as applied to Claim 1 and further teaches the sampled music input as shown in Fig. 
1 . Although Matityaho does not teach that the sampled signal was obtained using pulse code 
modulation, it is the applicant's admitted prior art that pulse code modulation is a very common 
and well-known method of representing an analog audio input as a series of digital audio 
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samples in the audio processing art. Thus, it would have been obvious to one of ordinary skill in 
the art, at the time of invention, to utilize PCM to obtain the music samples as shown in Fig. 1 of 
Matityaho to provide an easily implanted means of obtaining a sampled digital audio signal since 
the means for performing such a method step are well-known in the audio processing art and 
readily available. 

With respect to Claim 18, Matityaho recites the method for music classification as 
applied to Claim 1 . Also, although Matityaho does not specifically suggest method storage on a 
computer readable medium, it is that applicant's admitted prior art that it would have been 
obvious to one of ordinary skill in the art, at the time of invention, to store the music 
classification method taught by Matityaho on a computer readable medium to increase method 
compatibility and usability by providing a means for method use with multiple computer 
systems. 

7. Claims 7 and 33 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Matityaho et al in view of Soltau et al, and further in view of Rossum et al (U.S. Patent: 
5,763,800). 

With respect to Claims 7 and 33, Matityaho in view of Soltau teaches the method and 
system for music classification utilizing frequency band segmentation as applied to Claim 5. 
Matityaho in view of Soltau does not specifically teach that frequency bands grow according to 
the golden ratio of frequency with respect to pitch; however, Rossum discloses: 

The size of each of said frequency bands grows according to the golden ratio of 
frequency with respect to pitch (frequency doubling with each octave, Col 12, Lines 27-35). 
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Matityaho, Soltau, and Rossum are analogous art because they are from a similar field of 
endeavor in music data processing. Thus, it would have been obvious to a person of ordinary* 
skill in the art, at the time of invention, to modify the teachings of Matityaho in view of Soltau 
with the teaching of frequency band doubling with increasing octaves as disclosed by Rossum to 
provide further perceptual processing for music classification by separating a musical signal into 
various frequency bands that are indicative of musical notes (Rossum, Col. 12, Lines 30-35, and 
Col. 3, Lines 58-62). 

8. Claims 8 and 34 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Matityaho et al in view of Soltau et al, and further in view of Goldin (U.S. Patent: 5,969,654). 

With respect to Claims 8 and 34, Matityaho in view of Soltau et al teaches the means for 
dividing a frequency analysis result into frequency segments, as applied to Claims 5 and 31. 
Although Matityaho in view of Soltau et al does teach a maximum frequency of 20kHz based on 
the upper limits of human hearing (Page 1, Section IIA), a maximum of 1 1kHz is not specifically 
disclosed in the aforementioned prior art, however Goldin teaches a cutoff frequency of 1 1kHz 
(Col. 3, Lines 33-47). 

Matityaho, Soltau, and Goldin are analogous art because they are from a similar field of 
endeavor in music data processing. Thus, it would have been obvious to a person of ordinary 
skill in the art, at the time of invention, to modify the teachings of Matityaho with a cutoff 
frequency of 1 1kHz as taught by Goldin to conserve system resources by processing only a 
necessary frequency range since a frequency bandwidth of up to 1 lKHz is satisfactory for 
describing music data (Goldin, Col. 3, Lines 37-40). 
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9. Claims 9-10 and 35-36 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Matityaho et al in view of Soltau et al, and further in view of Dumais et al (U.S. Patent: 
6,192,360). 

With respect to Claims 9 and 35, Matityaho in view of Soltau et al teaches the method 
and system for music classification as applied to Claim 1. Matityaho in view of Soltau et al does 
not teach the use of a support vector machine as a first stage of a multi-stage classifier, however 
Dumais recites: 

First stage of said multi-stage classifier comprises at least one Support Vector Machine 
(use of support vector machines in pattern classification, Col. 10, Line 66- Col. 11, Line 15). 

Matityaho, Soltau, and Dumais are analogous art because they are from a similar field of 
endeavor in pattern classification. Thus, it would have been obvious to a person of ordinary skill 
in the art, at the time of invention, to modify the teachings of Matityaho in view of Soltau et al 
with the use of a support vector machine as a first stage of a multi-stage classifier as taught by 
Dumais to provide more accurate pattern classification through the use of a support vector 
machine (Dumais, Col. 4, Lines 51-54). 

With respect to Claims 10 and 36, Dumais further discloses: 

Multi-stage classifier comprises at least one Support Vector Machine per category of 
classification (Col 10, Line 66- Col 11, Line 15). 

10. Claims 12-13 and 38-39 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Matityaho et al in view of Soltau et al, and further in view of Yoda (U.S. Patent: 5,479,575). 
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With respect to Claims 12 and 38, Matityaho in view of Soltau et al teaches the method 
and system for music classification utilizing a neural network as applied to Claim 11. Matityaho 
in view of Soltau et al does not specifically suggest that the implementation of at least one input 
and output neural network nodes for each classification category, however, Yoda discloses: 

The neural network comprises at least one input node per category of classification, and 
further wherein said neural net comprises at least one output node per category of classification 
(Col 6, Line 55- Col 7, Line 19, and Fig, 5). 

Matityaho, Soltau, and Yoda are analogous art because they are from a similar field of 
endeavor in neural network based pattern recognition. Thus, it would have been obvious to a 
person of ordinary skill in the art, at the time of invention, to modify the teachings of Matityaho 
in view of Soltau et al with the implementation of at least one input and output neural network 
nodes for each classification category as taught by Yoda to provide an organized and reliable 
means of pattern classification since each class has an associated input and output node utilizing 
in determining a most likely pattern classification based on the neural network output (Yoda, Col 
5, Line 3-28). 

With respect to Claims 13 and 39, Matityaho additionally discloses: 
The neural network comprises a hidden layer, wherein said hidden layer comprises at 
least as many nodes as the number of said input nodes (hidden layer, Page 2, Section IIB). 

11. Claims 14 and 40 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Matityaho et al in view of Soltau et al, and further in view of Kramer et al (U.S. Patent: 
5,335,291). 
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With respect to Claims 14 and 40, Matityaho in view of Soltau et al teaches the method 
and system for music classification utilizing a neural network as applied to Claim 11. Matityaho 
in view of Soltau et al does not specifically suggest that the neural network operates on a 
Gaussian activation function, however Kramer discloses such a configuration (Col 4, Liens 33- 
44). 

Matityaho, Soltau, and Kramer are analogous art because they are from a similar field of 
endeavor in neural network based pattern recognition. Thus, it would have been obvious to a 
person of ordinary skill in the art, at the time of invention, to modify the teachings of Matityaho 
in view of Soltau et al with the neural network configuration utilizing a Gaussian activation as 
taught by Kramer in order to implement a more detailed and thorough method of pattern 
recognition through the use of activation rules which provide a mathematical description of how 
each node in the neural net processes information (Kramer, Col 1, Lines 38-47). 

Conclusion 

12. Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
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will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1. 136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

13. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure: 

Herrera et al ("Towards Instrument Segmentation for Music Content Description: A 
Critical Review of Instrument classification Techniques, " 2000) - teaches a method for music 
categorization utilizing support vectors. 

14. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to James S. Wozniak whose telephone number is (571) 272-7632. 
The examiner can normally be reached on M-Th, 7:30-5:00, F, 7:30-4, Off Alternate Fridays. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Wayne Young can be reached on (571) 272-7582. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 


James S. Wozniak 
8/3/2005 



W. R. YOUNG 
PRIMARY EXAMINER 


